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We present a statistical analysis of a single integration delta modulation 
system in which slope overload effects are negligible. In defining the delta 
modulation signal ensemble, ice identify a binary phase parameter and 
show that when this parameter is random, the signal statistics are stationary, 
provided the input is stationary. Thus the delta modidation correlation 
functions depend on a single time variable and have Fourier transforms 
that are the power spectra of the delta modulation signals. 

After deriving the delta modulation correlation statistics and power 
density spectra, we use these functions to investigate the properties of the 
delta modulation granidar quantizing noise. We demonstrate the ratio of 
input signal power to the quantizing noise power oj three signals that 
approximate the system input. These signals are the integrated delta 
modulation signal, the signal at the output of the ideal low-pass interpola- 
tion filler usually considered in delta modidation studies, and the signal at 
the output of the optimum interpolation filter. We determine the properties 
of this filter by referring to the derived spectral density functions. 

I. BACKGROUND 

Delta modulation (AM) systems are subject to two types of quan- 
tizing distortion, generally referred to as granular quantizing noise 
and slope overload noise. The overload noise arises when the analog 
input to the delta modulator changes at a rate greater than the maxi- 
mum average slope of the signal generated in the delta modulator 
feedback loop. The granular noise is analogous to pulse code modula- 
tion (PCM) quantizing noise; it arises because the AM signal is a 
discrete-time discrete-amplitude representation of a continuous-am- 
plitude process. 

After the discovery of AM in the early 1950's, two statistical analy- 
ses of distortion effects appeared. 1 Van de Weg considered a delta 
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modulator, constrained so that slope overload effects are negligible, 
and analyzed the effects of granular quantizing noise in a manner that 
paralleled Bennett's analysis of quantizing noise effects in a pulse code 
modulation (PCM) system constrained to be free of overload. 2,3 Zet- 
terberg, in 1955, published a study of both types of distortion as part 
of an extensive mathematical analysis of the AM process. 4 Zetterberg's 
expression for granular noise power is less precise than van de Weg's. 
His results pertaining to slope overload have recently been revised. 6 

Eleven years after the appearance of Zetterberg's paper an in- 
dependent analysis of slope overload noise was published by O'Neal 
whose effort was supported by S. 0. Rice. 6 O'Neal used van de Weg's 
formula to predict the granular noise power but obtained slope over- 
load characteristics that differed from those derived by Zetterberg. 
The reason for the two solutions to the same problem is investigated 
in a recent paper by Protonotarios. 5 This paper gives new expressions 
for the slope overload noise that are more accurate than any previ- 
ously obtained. Like O'Neal, Protonotarios uses van de Weg's char- 
acterization of the granular quantization effects. 

Although van de Weg's formula for granular quantizing noise power 
has been experimentally verified over an important range of operat- 
ing conditions, his statistical characterization is inadequate for cer- 
tain analytical purposes. A principal difficulty in this characterization 
is the nonstationarity of the AM signal ensemble. Because the sta- 
tistics are nonstationary it is not possible to calculate correlation co- 
efficients by Fourier transformation of the power spectral density 
function, derived by van de Weg as a mean square amplitude spec- 
trum. 

To admit the techniques of stationary time series analysis to the 
study of AM signals, we generalize the signal ensemble by defining a 
binaiy phase parameter. We derive correlation statistics directly as 
average products and show that if the phase is random with both 
values equiprobable, the ensemble is stationary. Thus we are able to 
compute power density spectra as Fourier transforms of the correla- 
tion functions and to compare the new formula for granular quantiz- 
ing noise with that given by van de Weg. We find that over the range 
of operating speeds considered by van de Weg and O'Neal that van de 
Weg's formula is a good approximation to the one presented here. For 
very low speeds van de Weg's approximations break down while the 
formulas we present in this paper are applicable to all AM sampling 
rates. 

An additional advantage of this analysis is the presentation of 



DELTA MODULATION 



1199 



cross-correlation statistics and the cross-power spectrum of the AM 
signal and the analog waveform it represents. We use the cross-power 
spectrum to derive the transfer function of the optimal interpolation 
filter for AM. We compare the output noise power of this filter with 
that of the ideal low-pass filter usually considered in AM studies. 
The correlation statistics presented here have also been used in the 
synthesis of optimal digital filters. 7 



II. the Am system 

The delta modulator shown in Fig. 1 transforms the continuous signal 
y(t) to the binary sequence 

• • • , b_i , &o i &i i 

in which &„ may have the value +1 or —1. The modulator generates 
binary symbols at t second intervals according to the sign of e(t), the 
error signal. This error is the difference of y(t) and x{t), the integrated 
AM signal generated in the modulator feedback loop. The term x(t) is 
the integral of the binary impulses weighted by the "step size," 5. Thus 
x(t) has a step of +5 or —5 at each sampling instant and is otherwise 
constant. At the AM receiver, this integrated AM signal is recovered 
by a replica of the modulator feedback loop and an analog signal, y(t), 
is generated by means of the interpolating filter with impulse response 
h(- ). The signal y(t) is an approximation to the system input, and in this 
paper the fidelity of the AM system will be measured by the mean square 
error, 

V = E{[y(t)-mf}, (1) 

in which E{ • } is the expectation operator. We assume that the binary 
signal processed by the receiver is identical to the one generated at 
the modulator. The effects of transmission errors are not considered. 

The two AM parameters are t, the sampling interval, and 8, the step 
size. The quantizing distortion decreases monotonically with increasing 
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Fig. 1 — The delta modulation system. 
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sampling rate, /. = 1/r, while for a fixed rate the value of the step size 
determines the mix of granular quantizing noise and slope overload noise 
in the quantizing noise signal, y(t) — y(t). In this paper we consider only 
the granular quantizing noise; thus we postulate a system in which 8 
is set such that 8/t, the maximum average slope of x(t), is exceeded by 
the slope of y(t) with very low probability. To serve this aim we follow 
van de Weg and establish the condition that 8/t is four times the 
root mean square slope of y(t). This condition is analogous to the "4cr 
loading" assumed by Bennett in his analysis of a PCM system with 
negligible overload effects. 3 For gaussian signals, the probability that the 
slope of 7/(0 is greater than 8/t is less than 4 X 10~ 5 . 

If y(t) is a sample function of a stationary stochastic process, the 
stated design condition may be expressed in terms of S uy (/) , the power 
spectral density of the process. The important parameters of 8 vv (f) 
are its average, 

« 2 = r S uu (1)df = E{[y(t)] 2 }, (2) 

J-00 

the mean square signal, and its effective bandwidth, 8 



/. = 



f fSJfidf 

J -00 

f BJft df 

- J— co - 



(3) 



The rms slope of y{t) is 2-7raf e - Thus the condition that the maximum 
average slope of x(t) equal four times the rms slope of y(t) may be 
expressed as 

8/t = 8iraf. 
or 

jS = 8/ a = 8irf e r = 8tt/F (4) 

in which we have related the AM parameters to the important signal 
parameters. Thus, /? is the step size as a multiple of the rms signal and 
F = fs/fc is the sampling rate as a multiple of the effective bandwidth. 
Equation (4) establishes /? for each sampling rate; in the analysis 
of granular quantizing noise to be presented, it is the sampling rate 
that is considered to be the independent variable of the AM system. 
Studies of slope overload indicate that for minimal total quantizing 
noise, $F, instead of remaining constant as it does here, should in- 



DELTA MODULATION 1201 

crease with increasing F* ,a In the numerical examples given by O'Neal 
and by Protonotarios, the value of fSF that results in minimal total 
quantizing noise approximates 8tt for the highest sampling rate con- 
sidered. 

III. THE SCOPE OF THE ANALYSIS 

The signals processed in the AM system have been analyzed as realiza- 
tions of discrete-time (sampled-data) random processes. The transmitted 
binary sequence, {&„}, the integrated AM signal, x(t), and the analog 
output, y(t), are all determined by the values of the analog input at the 
sampling instants, nr (n = • • • , — 1, 0, 1, • • • ). Thus the analysis 
reported here consists of derivations of the statistical properties of 
[x„] = {x(nr)}, the integrated AM sequence and {e„} = {e(nr)}, the 
error sequence, from the statistics of {y„} = [y(nr)), the input signal 
sequence. 

If y(t) is drawn from a stationary process with auto-covariance 
function <rp(-) [the Fourier transform of S uy (f)], the covariance 
coefficients of the AM signals may be expressed as functions of the 
statistics, p n = p(nr). The derived covariance functions are E{x&j}, 
the autocovariance of the integrated AM signal, and E{y&j}, the 
cross-covariance of this signal and the analog input. A property of the 
definition (in Section 5.1) of the ensemble of sequences {x„} is its 
stationarity in the wide sense. (Van de Weg considers a somewhat 
different ensemble, one that has nonstationary statistics.) Thus the 
covariances are functions of the single time variable, p = j — i, and we 
denote them r M (the autocovariance) and fo (the cross-covariance) re- 
spectively. Also of interest is Q^, the error covariance function given by 

Q„ = E{e n e n+I1 } = a 2 Pil + r„ — <fc, — 0_„ . 

It is shown in Section 5.4 that the covariance statistics, fo t are pro- 
portional to <t 2 Pii , the autocovariance of the continuous input. Thus fa 
= </>_ M and the error covariance function is given by 

Q„ = <r 2 p„ + TV - 20, . (5) 

Because the processes under consideration are stationary, their 
power density spectra are Fourier cosine series with coefficients given 
by the covariance statistics defined above. The spectra are periodic 
in frequency over intervals of 1/t Hz ; they are denoted with asterisks 
in keeping with conventions of sampled data analysis. We apply the 
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Fourier series representation : 

CO 

A*(f) = fl + 2 J a, cos 2irnJT 

n-l 

so that 

On - 2r [ ' A*(f) cos 2tt7i/t d/. (6) 

Jo 

In the sequel we will denote these Fourier transform relationships be- 
tween A* (/) and a„ by A* (/) < — > a„. 

The power density spectrum, S* v (f), of the samples of the analog 
input is related to S uy (f), the power spectrum of the continuous input 
signal, by 

* 2 p, ~ S* v (1) = ; j£ £U0 + */.) • (7) 

It follows that if i/(£) is bandlimited to W < f s /2 Hz, there is no 
aliasing distortion and 

S* v (1) =-S vy (f), for |/ | </./2. (8) 

T 

The other transform pairs of interest are S*(J) <-> r tf , S*(f) <-> Q M > 
and S*(f) «-* M . *S X *(/) and S*(J) are the power spectral density func- 
tions of the integrated AM signal and the error signal, respectively. 
S? v (f) is the cross-power spectrum of the integrated AM signal and the 
analog input. Equation (5) implies that the four power density spectra 
are related by 

S*(f) = S* x (f) + S* v (f) - 2S*,(j). (9) 

These spectral density functions and H(f), the transfer function of 
the interpolating filter, determine the value of the output quantizing 
noise power defined in equation (1) .f Thus, 

V = 2r f' 2 \S* v (f) - 2Re [H(j)S*m + \ //(/) | 2 SUM df (10) 

so that the transfer function of the optimal interpolation filter, that is, 
that which minimizes -q, is the (nonrealizable) Wiener filter, 9 ' 10 



t It is assumed here that H(f) processes a sequence of ideal impulses. In Fig. 1 
the filter input is a sequence of flat pulses of t second duration so that when a 
filter described in this analysis is to be included in a real system, its transfer 
function should be weighted to compensate for the aperture effect. 3 
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for | / | =g /./2 



Vml, 



-r{ 



S*y(f) ~ 



dj. 



(ID 



(12) 



SU1) 
= 0, for | / | > /./2. 

The associated minimal quantizing noise power is 

[SUfif 
s* x (j) 

In previous AM studies it was assumed that y(t) is bandlimited 
to W Hz and that the interpolation is performed by a perfect low pass 
filter with transfer function 

H l9/ (f) -1, for \f\gW 

= 0, for | / | > W. 

Equation (10) indicates that the quantizing noise power associated 
with this filter is 



Vipf 



= 2t f W [5* (/) + SUf) ~ 25* (/)] df 
= 2r [ S*.(f) df. 



(13) 



Thus the quantizing noise power associated with the low-pass filter 
is the portion of the power of the error signal that lies within the band 
of the analog input. By substituting the Fourier series with coefficients 
Qn into equation (13) we arrive at the formula for the low pass filter 
quantizing noise in terms of the error covariance coefficients: 



Vlrf — 



Q + 2 2 Q- 



sin 



(14) 



in which R = f a /2W is the bandwidth expansion ratio of the AM sys- 
tem. It is the ratio of the AM sampling rate to the Nyquist sampling 
rate of the input signal. The ratio, F/R, of the two normalized sam- 
pling rates is 2W/f c , twice the ratio of the highest frequency spectral 
component oiy(t) to the effective bandwidth. 

IV. PRINCIPAL RESULTS 

4.1 Covariance Coefficients 

By means of the formulas of the preceding sections, the charac- 
teristics of granular quantizing noise may be expressed in terms of 
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the correlation statistics p^, r^, and 4^. These quantities depend on 
the nature of the analog input and on the normalized sampling rate, 
F. Details of the derivations of r^ and M , when the input is drawn 
from a stationaiy gaussian process, are given in the subsequent sec- 
tions of this paper. Here we present the covariance formulas and use 
them to investigate the quantizing noise properties. 

As multiples of the mean square input, the autocovariance coef- 
ficients of the integrated AM signal are 

7 = 1 +4 g exp |_- —J + -p-j- + Z^pexp |_- — Jj> 



„ 1 + 4 g exp [- ^]} + P t t i [1 + ("in 



1! 
(7 



exp 



^ 2 (fc 2 + w?. 2 - 2wfcp 



128 



^)]_ exp [_n* 



*.f mk 

+ m 2 + 277?/cpj' 



128 
for ju even, 



i = P,{l+4 Jexp 



F% 2 
32 



]} + flS^(-«- 



'I exp 



[-•- 



F 2 (k 2 + m 2 - 2mk Pll ) 



128 



— exp 



F 2 (k 2 + m 2 + 2m/cp„) 
128 

for n odd. (15) 



The cross-covariance function of {x n ) and {y„} is proportional to 
o- 2 ^, the autocovariance function of {?/„}. Thus 



-2 = cp„ 



(16) 



where 



= 1 + 2 £ exp 



i-m- 



(17) 



Q,i, the autocovariance of the error signal, is related to p M , r^, and 
£ p through equation (5) . Therefore 



On _ 64x! ii . f_L 
cr 2 /^ 2 13 + ef 7r 2 fc 2 



exp 



Q 



7 = P|:i:^[i + (-iri-,- 



F 2 /c 2 
32 

F 2 (/c 2 + m 2 - :'////,».,! 
128 



(18) 

] 
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— exp 



F 2 (k 2 + iri + 2mfcp„ 
128 



, for n even, 



F ^i timk 



— exp 



[-'- 



F 2 (k 2 + m 2 + 2mfc P „) 



128 



F 2 (fr 2 + m - 2mk Pll ) 
128 

for /i odd. 



]}■ 



(19) 



4.2 The Minimal Output Quantizing Noise Power 

The proportionality of the autocovariance of the input signal and the 
cross-covariance of the input and the integrated AM signal implies that 
the related spectra are also proportional: S*{f) = cS*(J). When this 
relationship is substituted into equation (12), the formula for the quan- 
tizing noise power at the output of an optimal interpolation filter, the 
result is 






S*(f) 



1 - 



(2c - 1)5* (fl + S*(/)J ' 



(20) 



in which equation (9) has been used to substitute for S*(J). By algebraic 
manipulation equation (20) may be shown to be identical to 



»7min 



(2c - 1) : 



■{*/ 



5* CD df-2 



T !w= 



[s*M 



df 



(2c - 1)5* </) + 5* (/) 
- ( j^¥-2rj SZ v (f)df (21) 



in which the integrals are taken over the set of / in ^ / ^ /./2 for 
which 5*(/) ^ 0. The third integral in equation (21) is a 2 /2 T ; if the 
input is bandlimited to W Hz [with S *(/) 9* for | / 1 < W], the first 
integral is that given in (13), i? Jp/ /2t. It follows that equation (21) may 
be rewritten as 



17min = 



(2c - l) 5 



Vipf 






\S*(f)f , f 

(2c - 1)5*0) + 5*0) a7 J 

(c ~ I) 2 2 
~ 2c - 1 



(22) 



Thus for a bandlimited signal, equation (22) relates the quantizing noise 
power at the output of a low pass interpolation filter to the noise at the 
output of an optimal filter. As the sampling rate increases, c — » 1 and 
the integral in equation (22), of a quadratic form of the coefficients, Q„ , 
becomes negligible relative to rn vf which is the integral of a linear form. 
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Thus for high sampling rates, 77 min Pt; i\ lv[ , indicating that the transfer 
function of the optimal filter is nearly flat over frequencies at which 
S*(f) ^ and is zero where S*(f) = 0. 

4.3 Approximations 

The infinite series in the formulas for the covariance coefficients 
converge rapidly, and in many cases of practical interest, entire series 
contribute negligibly to the values of the coefficients. For example, if 
the input possesses a flat power spectrum, cutoff at W Hz, the effec- 
tive bandwidth is 17/(3)* and the normalized sampling rate is related 
to the bandwidth expansion ratio by F = 2(3)* R. Thus for R > 12 
AM samples per Nyquist interval, the single summations in equations 
(15), (17), (18) and (19) consist of powers of a e -54 or less. These 
summations are added to 0.25 or to ir 2 /Z and thus have negligible ef- 
fect on the values of the covariance coefficients. In the double sum- 
mations, only the terms obtained with the two indices equal contribute 
significantly to the total when F is high. These double summations 
may, therefore, be replaced by single sums and we have the following 
approximations : 



(23) 
(24) 



a 2 ~ * + 6F 2 






r, . 256 ^ (-1)"* / 


F 2 k 2 ) 
64 ) 


-*(*■ 


(X 






Q„ 647T 2 2 , q 
c 2 - 3^2 - P 16 






a 2 ~ F 2 hi k 2 T \ 64 j 


sinh 


m 



(25) 

If in equation (25) we approximate sinh x by e"/2\ and substitute the 
result in equation (14) for t\ lvt , we obtain van de Weg's formula for the 
granular noise power. Van de Weg claims its validity for R ^ 2 samples 
per Nyquist interval. Our precise formula for Q„ , equation (19), leads 
to noise power characteristics that are valid for all sampling rates. 



t This leads to a small but nonzero value of Q,i as p — > °o and p A — > 0. Reten- 
tion of the e~ x term in the approximate formula for Q„ results in Q* = and thus 
avoids an anomaly and a source of numerical error in van de Weg's noise power 
formula. 
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4.4 Signal-to-Noise Ratio Characteristics 

In this section we demonstrate the nature of the derived quantizing 
noise characteristics by illustrating the effect of the AM sampling rate 
on the quantizing noise powers, ^ p/ and r) m i n , and on Q , the mean 
square error at the input to the interpolation filter. In particular, Fig. 
2 shows on a dB scale, S npt = <T 2 /7^ in , the output signal-to-noise ratio 
of an optimal interpolation filter; S, pf = o- 2 /^ p/ , the signal-to-noise 
ratio of a low pass filter; and S = o- 2 /Qo the signal-to-noise ratio 
prior to interpolation. The data in Fig. 2 pertain to the case of a zero- 
mean stationary gaussian input with a flat bandlimited power spec- 
trum. The signal-to-noise ratios are shown as functions of R, the num- 
ber of AM samples per Nyquist interval. 

For high sampling rates, equation (25) indicates that Q is ap- 
proximately 8 2 /3, the mean square value of a random variable dis- 
tributed uniformly over an interval of length 28. Thus with increas- 
ing R, S rises at the rate of 20 dB per decade. At high sampling rates 
Si pf and S opt are nearly identical. Their slope is 30 dB per decade as 
indicated by equation (14) which is a linear combination of the error 
covariance coefficients (proportional to R~ z ) , weighted by \/R. 

At low sampling rates, S and S, pf become very low (-15 dB at the 
Nyquist rate) while S npt tends toward unity, corresponding to a filter 
that generates zero output (the mean input), and thus has a mean 
square error of a 2 . 

V. DERIVATION OF COVARIANCE STATISTICS 

Although the AM system considered in this paper is identical to 
the one studied by van de Weg and the values obtained for granular 
noise power are virtually the same as his over a wide range of trans- 
mission speeds, the method of analysis used in obtaining the present 
results differs considerably from van de Wcg's. "Van de Weg formu- 
lated the ensemble of integrated AM signals as a nonstationary proc- 
ess; he was thus unable to compute spectral characteristics from 
derived covariance statistics. Instead of considering correlation prop- 
erties, van de Weg began with the amplitude spectrum of a sample 
function of the integrated AM signal ensemble. He then calculated 
the power density spectrum as the mean square amplitude spectrum. 

In the work reported in this paper, the ensemble of integrated AM 
signals is stationary in the wide sense, so that the power spectra are 
Fourier transforms of the covariance functions whose derivations are 
described in the remainder of this paper. The difference between van 
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Fig. 2 — Quantizing noise characteristics. 



de Weg's signal ensemble and ours lies in the role of the binary phase 
parameter defined in the Section 5.1. 

5.1 The Integrated AM Signal Ensemble 

The integrated AM signal, {x n }, is a discrete-time discrete-amplitude 
function. The signal ranges over values k8 (k = 0, ±1, ±2, • • •), and 
the absence of slope overload implies that x n takes on the value of the 
allowed quantization level nearest to y n . (In overload conditions, x n 
and y„ may differ considerably.) At any sampling instant, the set of 
allowed quantization levels of a given signal is either the odd-parity 
subset of quantization levels, 



±5, ±35, ±55, 



(26) 



or the even-parity subset 



0, ±25, ±45, • • • . (27) 

This restriction to a subset of the k8 follows from the AM mechanism 
which constrains each sample of {x n } to differ by ±8 from its predeces- 
sor. Thus if x = 2k8, Xj = (2k ± 1)8 and any sample that may be 
written x 2m (m = 0, ±1, ±2, . . .) is constrained to an even-parity 
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value. Similarly the subsequence {x 2m+1 } ranges over the odd-parity 
set of quantization levels. 

Thus in the absence of slope overload, x n is the result of processing 
y n with a uniform PCM quantizer with quantization intervals of 
length 28. Either x„ is the output of the even-parity quantizer, with 
levels given by equation (27) or the output of the odd-parity quantizer 
with levels given in equation (26). The input-output characteristics 
of the two quantizers are shown in Fig. 3. 

In denning the AM signal ensemble, van de Weg assumed that the 
"initial condition," x = 2k8, applies to all sequences {x„). In van de 
Weg's analysis, therefore, all samples in {a>> m } are generated by the 
even-parity quantizer and all samples in {x 2m+1 } are generated by the 
odd parity quantizer. Thus the probability functions of x 2m and Xo m+1 
differ and the ensemble of sequences {x n } is nonstationary. 

We now generalize van de Weg's formulation of the integrated AM 
signal ensemble by observing that the AM system may also generate 
signals with the initial condition, x = (2fc-l)o. In this event {x 2m } 
is the output of the odd-parity quantizer of Fig. 3 and {x 2m+1 } is the 
output of the even-parity quantizer. We shall refer to the initial con- 
dition that applies to a given {x n } as the "phase" of the signal. Thus 
we define the two phase states : 

Aj.: {x 2m } generated by the even-parity quantizer 
A 2 : {x 2m } generated by the odd-parity quantizer. 

A delay of a signal by t seconds results in a phase reversal from A x 
to A 2 or from A 2 to At . 
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Fig. 3 — Two uniform quantizers: (a) even-parity quantizer, (b) odd-parity 

quantizer. 
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If we admit signals with both phases to the AM ensemble, the 
statistics of the ensemble of {x„) depend on the relative frequency of 
occurrence, that is, on the prior probability of the two phases. Van 
de Weg's ensemble is a "coherent" one for which the prior probability 
function is 

Pr \A l ) = 1, Pr {A 2 } = 0. (28) 

In this paper we study the statistics of the noncoherent ensemble in 
which 

Pr [A l ] = Pr {A 2 } = |. (29) 

The correlation analysis begins with the derivation of probability 
functions conditioned on each of the two phases. Marginal proba- 
bilities may be calculated on the basis of a prior probability func- 
tion as 

Pr {x n = k5} = Pr {A 1 } Pr {x n = U \ A t } 

+ Pr \A 2 ) Pr {x n = U\A 2 ). (30) 

When equation (29) is used in the computation of equation (30), the 
result is independent of n. Similarly the joint marginal probability of 
x n and .r ra+/t is independent of n when equation (29) is accepted. When 
equation (28) is accepted, as it is in van de Weg's analysis, both the 
single and joint probability functions depend on the parity of n and 
the covariance statistics are functions of two time variables. 

In principle, either equation (28) or (29) may be applicable to the 
operation of a particular AM system. In practice, numerical results 
based on the two phase conditions are usually quite similar. In analytic 
work, there is a considerable advantage offered by equation (28), the 
noncoherence assumption. It admits the techniques of stationary time 
series analysis to the investigation of questions of interest. 

5.2 The Probability Distribution of x n 

Here we derive the probability function of a sample, x n , of the in- 
tegrated AM signal. The probabilities conditioned on A-i and A 2 de- 
pend on whether n is even or odd, but the marginal probability func- 
tion is independent of n when A\ and A% are equiprobable. 

Under the condition A 1} the samples {x^m} are outputs of the even- 
parity quantizer so that x^m — 2fc8 when 

(2k - 1)5 ^ y 2m < (2k + 1)8. 
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If {y n } is a sample function of a stationaiy zero-mean gaussian proc- 
ess with variance o- 2 , we have 

Pr [x 2m = 2k8 | .4,} = -t^-tx exp ( - — 2 ) du 

Pr {x 2m = (2& - 1)5 | A,} = 0. 
The samples {x 2m +i} are generated by the odd parity quantizer so 
that 

Pr {.r 2m+1 = 2/c5 | ,1,} = ^ 

Pr {x 2m+1 = (2k -1)51^=^1 f" t _ 2)s exp (- £) *.. 

Under the condition A 2 , the complementary probability function 
applies : 

Pr {x 2m = 2k8 | A 2 } = Pr {x 2m+i = (2k - 1)5 | A 2 } = 0, 

Pr \x 2m = (2k - 1)5 | A 2 ) = Pr {rr 2m+1 = (2/c - 1)5 | A,|, (33) 

Pr {x 2m+i = 2kS | A 2 ) = Pr {z 2jn = 2U \ A,}. 

By combining equations (30) to (33), one may demonstrate that 
Pr{.r„ = fcS} depends on n (in particular on whether n is even or odd) 
for all prior probabilities of A x and A 2 except the equiprobable pair 
given in equation (29). Thus equation (29) is a necessary condition 
for stationarity. When this condition is imposed and /? = S/o- incor- 
porated, the formula for the marginal probability of x„ becomes 

From equation (34), the moments of x n may be calculated. We have 



and 

E{xl) = r = J|i j£ k s ^ exp [- f (v + /c) 2 ] dv, (36) 

which is equivalent to the form of ?- given in equation (15). The 
derivation of equation (15) from (36) is demonstrated in Section A.2 
of the appendix. 
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5.3 The Joint Probability of x n and x n+ „ 

For each phase condition, the expression of the joint conditional 
probability of x n and x„ +/I , depends on the parity of n and the parity 
of fx.. For phase Ai, x n and x n+/l are both generated by the even-parity 
quantizer when n and /i are even numbers. Thus the conditional 
probability that x n = 2/cS and Xn+p = 218 is the probability that 

(2k - 1)5 = y n < (2/c + 1)5 and (21 - 1)5 ^ y n+ll < (21 + 1)5. 

Thus for n and n both even, 

Pr {x n = 2k8,x n+ll = 218 | A,} 

i M2* + 1)J ,.(2J + l)i f „,2 I 2 ft "I 

= 9—57; 27i / / ex P o-37i -2T-\dudv 

Pr {z n = (2k - 1)5, z n+M = 18 \ Ax) 

= Pr [x n = k8, x n+li = (21 - 1)5 | A,} = 0. (37) 

Similarly we derive conditional probability expressions for the 
eight cases listed under step 1 in Table I. The four marginal proba- 
bilities indicated under step 2 are calculated as 

Pr {x n = k8, x n+ll = 18} = I Pr {x n = k8, x n+ll = 18 \ At) 

+ § Pr {x n = k8, x n+ll = 18 I A 2 \. (38) 

Among the four cases there are only two different formulas. One is 
applicable to even values of //. and the other to odd values of p.. When 
/x is even, x n and x n+M , are generated by the same quantizer and when 
p. is odd they are generated by different quantizers. The marginal 
joint probability function is independent of n. It may be expressed in 
terms of the double integral expression 

P<*. 1. «) - 4.(1 - & ]<»„ eXp \~V 

.[" ) \w\- t~ Vp '£ ~\dudo (39) 

J(i-Df) L Ai — Pm)J 



as 

Pr {x n = k8, x n+ll = 18} = p(k, I, n) for k + I + n even 

= f or A; + I + /x odd. 



(40) 
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Table I — Steps in Deriving Pr \x„ = kS, x n+ll = 18} 



Step 1 

Conditional 

probabilities 

obtained for cases 


Step 2 

Marginal 
probabilities 


Step 3 

Identical 

expressions except 

for cases 


n even, n even A\ 
n even, n even A 2 


n even, p. even 


n even 


n odd, n even A\ 
n odd, fi even A 2 


n odd, *« even 


n even, /z odd A\ 
n even, t* odd A* 


n even, it odd 


M odd 


n odd, /* odd 4i 
n odd, n odd 4 2 


n odd, n odd 



The autocovariance coefficient, r^, is the expected product of x„ and 



Wi + it 



00 00 



r,= E J (k8)(l8) Pr {.r n = k8, x n+ll = Z5}. 

Jt--oo l = -oo 

Substitution of equation (40) into (41) results in 



(41) 



r„ - 8 2 Z E (2k)(2I)p(2k, 21, „) 

A - — oo I ■ - oo 

00 00 

+ 8 2 X) Z (2ft - 1)(2Z - l)p(2fc - I, 2Z — 1, p) for m even 



*-— 00 I — 00 



r „ = 28 2 £ Z (2*0(2/ - l)p(2fc, 2/ - 1, M ) for M odd. 

*--00 J--0O 

(42) 

Section A.3 of the appendix outlines the derivation of equation (15) 
from (42) and (39). 

5.4 The Joint Distribution of y n and x n+M 

Here we consider the joint probability function of a discrete random 
variable, x„ +ll and a continuous random variable y„. Once again the 
marginal distributions are independent of n when the two phases are 
equiprobable. For /x = 0, the marginal probability function is 
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Pr [y n = u, x n = k8\ = ^-* exp (- ^) du 

for (k - 1)5 ^ u < (k + 1)5 , 

= for other values of u. 
The expected value of x n y„ may be computed as 

#{*,,#,.} = 4>o = 575-3 23 fc / u exp ( - — 1 rfw (44) 

which is shown in Section A.4 of appendix to be ca 2 , with c given by equa- 
tion (17). 

For other values of n, the conditional probability function of u and 
k8 is the probability that y„ = u and (/c — 1)5 ^ y n+ll < (k + 1)5, 
provided k8 is an output level of the quantizer that processes y n+lx . The 
marginal probability function may be written as 

Pr \y n = u, x n+ll = k8} 

- 4™ 2 (1 - p3» L„, 6XP L~ 2. 2 (l-p 2 ,) J * * W 
from which cross-covariance coefficient fa may be calculated as 

oo poo 

M = S &8 / « Pr {y» = u > *»+, = hS] . (46) 

k=.-oo •'-00 

If equation (45) is substituted into (46) and the integration with 
respect to u is performed first, the result is 



- CO »(* + l)0 / 2\ 

fe^L^i-s)* (47) 



** 2(2tt) 
which is equation (44) multiplied by p^,. 

APPENDIX 

Applications of the Poisson Sum Formula to the Derivation of 
Covariance Coefficients 

A.i Basic Formula 11 

f(x,t)= £ exp[-l(x + n) 2 ]. (48) 

n-— 00 

f{x, t) = (^)Tl + 2 g exp (- ^) cos Ms]- (49) 
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A. 1.1 Even Terms 

(l(x, t) = £ exp [-t(x + 2nf) = /(| , 4/ 

n** — oo 

g(x, I) = | (=)*[l + 2 f exp (- *£) cosxte]- 
a. 1.2 Otfd Terms 

h(x, t) = f) exp [-/(.r + 2n - l) 2 ] = /(x, /) - <7(x, /) 

Hx, t) = \ (=)*[l + 2 g (-1)' exp (- ^f) cos.**} 

A.2 Mean Square Value of x n 

Equation (36) may be developed in terms of the partial derivatives 
of equation (48) : 



(50) 
(51) 

(52) 
(53) 



/.(«, = - S fa + n) 2 exp [-/(* + nf] 



and 



(54) 



(55) 



/x(z, = -2t 2 ( ;c + ™) ex P [-'(* + w)* 1 - 

n-— oo 

Equations (54) and (55) may be combined to form 

f; ti 2 exp [-!(x + n) 2 ] = .r 2 /(x, t) + j f x (x, t) - Ux, t). (56) 

II ■=■ - CO 

If the order of summation and integration in equation (36) is reversed, 
the resulting integrand is identical in form to the left side of equation 
(56). Thus equation (49) may be substituted into the right side of equa- 
tion (56) and the three terms integrated over ^ * ^ 1. The result is 

f S n 2 cxp[-/(.T+n) 2 ]d.r 

-£(•)'[■ + « 5 »(-'-ffi 

2 j 2\~\ 

(57) 



m+m <*>(--- 



The variable, t, in equation (57) is related to equation (36) by t = 
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/? 2 /2 = 32tt 2 /F'-; when this latter form is substituted for t, the form 
of r given in equation (15) results. 

A.3 Autocovariance Coefficients 

In order to illustrate the derivation of equation (15) for r^ from 
equation (42), we consider odd values of p. By substituting into equa- 
tion (42) the form of p{k, I, p) given in equation (39) we write 

7-7j T3 Z 2k exp I - V -)G(v) dv, (58) 



r„ = 
in whicli we have defined 



(59) 



G(v) = ft f~ l t (21- 1) exp [- 02 % + 2l ~ 1)2 1 dz. 

The integrand in equation (59) is related to the infinite series in equa- 
tion (52) and its partial derivative with respect to x by 

S (2?i - 1) exp [-t(x + 2n - l) 2 ] = -xh(x, t) - ^ h x (x, t), 

(60) 

in which the variable t = /3 2 /2(l — p 2 ). Into equation (60) we substitute 
the form of h(x, t) given in equation (53) and perform the integration 
required in equation (59). The integral of the second term is zero so 
that G(v) is /3 times the integral of the first term of equation (60). Thus 
equation (58) may be written in the form 

G(v) = [2tt(1 - pl)]> 

•\7 + 2 £™ exp L w — J sin ^7' (61) 

which must be weighted by exp(— v 2 /2) and integrated according to 
equation (58). 

Equations (58) and (61) thus show r^ to be the sum of two terms. 
The first term consists of a constant, p ll uh/{2Tr) h , multiplying the sum 

oo -<2* + l)/S / 2\ » V r 2 i 

£ 2k / vexp(- V -)dv = 2 ]T exp - ^- (2k - l) 2 • 

i_-oo «'(2*-l)/3 V 61 k oo L ^ J 

(62) 

This latter summation is in the form of equation (52) with x = 0, t = 
/? 2 /2 so that with the application of equation (53), (62) becomes 
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The second term in the expression for r A may be written in the form, 



oo «(2*+l)0 / 

•E2i exp [- V - ( 



_. sin »5^^ (64) 



If the sine in this expression is developed in exponential form, the 
summation, ranging over k, in the above expression, has a form 
similar to the integral and sum in equation (59). If it is analyzed in 
the manner that G(v) was reduced the following identity may be 
demonstrated : 



E*/ 

1----CO J(2*-l 






2/3' 



irrupt ^ (— 1) 

. p t=\ irk 



X exp I — i^-Jsinh 



2/T 



t)^(^)~\. 



(65) 



Thus equation (64) becomes 



2p„o- 2 X ex P ( - 



7rm 1 , rt „2 v> v-> ( — 1) 



2/3 2 



+ 25 2 Z Z 



2/7.2 



•exp 



[ 7r 2 (fc 2 + m 2 ) 1 . Ar'fempA .... 

L w — J smh h?~J (66) 



so that r^ for p. odd, the sum of (66) and p^aB/ (2tt) 1/2 times (63), may 
be expressed as 



= pA 1 + 4 £ exp - 



2^ 



P^/_ 



+ 25 2 £ E 



(-D' 



*_1 m _i T 



km 



■ ex p[- ^ m ' ) ] 3inh (^ £ )- < 67 > 

If 87r/.F = /?* is substituted in equation (67) the result is equation (15) . 
Similarly the formula given in equation (42) for r M when p. is even 
may be developed to demonstrate its identity to the formula in equa- 
tion (15). 
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A.4 Cross-Covariance 
Performing the integration indicated in equation (44) we have 

*• - 2&? Jl 4 exp [- 2 ( * " 1)2 ] - «p [- 1 (* + »'_ 



5(7 



± exp[-f^], 



(2^^„ eAp L~ 2 "J" (68) 

which is equivalent to equation (48) with x = 0, t = B 2 /2 = [32 ?r 2 / 
F 2 ]. Thus equation (49) may be substituted with the result given in 
equation (16) : 



»o = o" 



[l+2g exp (- 



2 7 2 



2rlc 
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